Roger Kaufman

Roger Kaufman, Ph.D. is an influential figure in the history of the educational technology (see also Instructional design) and performance improvement fields as well as strategic thinking and planning for public- and private-sector organizations.[1] Regarded as one of the founding figures of the field,[2] he is referred to as the father of needs assessment.[3] While needs assessment is such common practice today that many new practitioners may not be able to envision a time when it was not part of the standard process, his work in this area established one of the foundational concepts that sets professional practice apart.[4] The core tenets of his work are reflected in the professional standards for certifying performance technologists, such as the emphasis on system thinking and planning and sound evaluation of outcomes.[5] Over his 40 years of work Kaufman developed what he considers to be his essential work - the Mega Planning model, a framework for adding measurable value to society.[6] Kaufman currently works with a variety of organizations around the globe implementing the Mega Planning model for strategic organizational planning, including educational institutions, government organizations, and corporations.

Contents

Brief Bio

Kaufman was born and raised in Washington D.C. The son of a mathematical physicist/electrical engineer, Kaufman credits his father's influence for how he has approached his work. In a recent interview with Stephanie Moore, Kaufman explained how there are both two kinds of calculus - differential and integral. First we learn to differentiate, then we learn but don't always apply integration. This began to drive him to look for how everything integrates, "how it all goes together," which led him to develop his Mega model and the Organizational Elements Model (OEM) that links three levels of results with two levels of resources and methods. Kaufman's bachelor's degree from George Washington University in Psychology, Sociology and Statistics. He completed a Master's at Johns Hopkins University in Psychology and Industrial Engineering. This foundation in both psychology and industrial engineering, along with his emphasis on statistics and social sciences, played a significant role the development his Mega planning model for measurable societal value added as a strategic planning model for organizations. Kaufman completed his doctorate in Communications at New York University. He previously spent time at University of California, Berkeley completing additional doctoral work in Industrial/Organizational Psychology.

Kaufman's professional work has been in multiple industries. Prior to his academic positions, he worked for aerospace organizations including Martin-Baltimore (now Lockheed), Boeing and Douglas Aircraft Company primarily focused on human factors, training, and research. In 1998, he established Roger Kaufman & Associates, a team of human performance professionals who consult with organizations on strategic planning and performance improvement. Upon completion of his doctorate, Kaufman taught at several universities, UC Irvine (adjunct professor), Chapman University (Professor of Education), United States International University (Professor of Psychology and Human Behavior), New Jersey Institute of Technology (Research Professor of Engineering Management), and University of Central Florida (Industrial engineer faculty Affiliate). From 1997-2004, Kaufman contributed at Old Dominion University as Research Professor of Engineering Management.

Concurrently with most of this work, Kaufman was a professor at Florida State University (FSU), from 1975–2003, for the position he would eventually be awarded professor emeritus status in Educational Psychology and Learning Systems and awarded the Professorial Excellence Award. While at FSU, Kaufman established and directed the Center for Educational Development and Evaluation and also served as Director of the Office of Needs Assessment and Planning all with the Learning Systems Institute. During his time at FSU he worked on numerous initiatives for the state of Florida on needs assessment, evaluation, and societal planning, including work with the Florida Department of Education, Florida Department of Law Enforcement, Florida Division of Blind Services, Division of Adult & Community Education, the Governor's office,and the United States Navy (Chief of Naval Education & Training/Office of Naval Research) - to name just a few. In August, 2004, he became Distinguished Research Professor at Sonora Institute of Technology (ITSON) in Sonora, Mexico.

Kaufman has been the recipient of numerous professional awards including Fellow (American Psychology Association), Fellow (American Educational Research Association), Fellow of the American Educational Research Association, Distinguished Contribution to Workplace Learning and Performance (ASTD), and Meritorious Public Service Medal (US Coast Guard/Department of Homeland Security). He was co-founder of what is now the International Society for Performance Improvement (ISP) International Society for Performance Improvement. He has received 14 awards from the associaion including Significant Contribution Award, and Honorary Member-for-Life (their highest honor). He has served as President of ISPI and founded the New York Chapter of the association. Kaufman has published over 275 articles and 39 books on strategic planning, change management, needs assessment, assessment, evaluation and organizational improvement.

Needs Assessment

One of the defining characteristics of Kaufman's work is his emphasis on "need" as a noun, not a verb; it is a gap in results and consequences, not a gap in resources or methods. Kaufman explains when "need" is used as a verb, it presupposes a solution before identifying the actual problem to be solved. When using 'need' as a verb, an intervention has been selected prior to a clear definition of the actual gap in results that would be addressed. Once a gap, or need, is accurately identified, only then can a means be sensibly selected for moving from current to desired results.

Kaufman expanded this approach to "need" from looking at gaps in products to gaps in outputs and then outcomes: from building block results to results delivered outside the organization to external client and societal results - what the organization used, does, produces, and delivers and the consequences all of that adds measurable value for our shared society. Used in this way, cost-consequences estimates may be made to prioritize closing gaps on the basis of the cost to meet the need as compared to the costs to ignore the need.

Kaufman identified three types, or levels, of needs: Mega, Macro, and Micro.[7] And Change, Choices, and Consequences published by HRD Press. The following table details the levels of needs and their definitions.

Name of the Organizational Element & Level of Planning Brief Description
Outcomes/Mega Results and their consequences for external clients and society
Outputs/Macro The results an organization can or does deliver outside of itself
Products/Micro The building-block results that are produced within the organization
Processes The ways, means, activities, procedures and methods used internally
Inputs The human, physical, and financial resources and organization can or does use

These levels of needs are also levels of planning for any organization and indicate a relationship between the levels. Alignment of objectives at each level is critical to ensure that planning translates into clear organizational operations and ensure that activities at each level add value back up the chain linking measurable to societal value-added.[8] As a consequence, no level of results is any more important than the others. Rather, it is the alignment of all levels that is critical to achieving desired results.

Extensive examples of planning and aligned objectives can be found in Moore, 2010 and Moore, Ellsworth & Kaufman, 2008.[9]

Mega Planning

Kaufman has developed a model for strategic thinking and planning he calls "Mega Planning." Kaufman argues that many organizational planning models incorrectly begin, and end, with internal or organizational performance and therefore fail to provide organizations a chance to plan how they deliver value outside of their organizations. Traditional planning ends with "Macro" level results, which are organizational results such as profits, graduation rates, ratings, etc. While these are important measures of organizational performance, they do not indicate the impact of an organization on external clients and society. Kaufman's model is similar to some of the concepts behind "double bottom line" literature.

"Mega Planning" starts with the question of "What kind of world do you want for your children and grand-children?" with responses distilled in terms of consequeneces.[10] An Ideal Vision defines the measurable variables for Mega planning including survival, self-sufficiency, and quality of life. He calls Mega planning (a system approach) "Mother's Rule" because if you ask just about any mother what kind of world they want for their children, they don't talk to means (credentials of teachers, money spent on social programs) but the survival, health, and happiness of their children.

Basic Ideal Vision for Society - indicators for societal well-being

! BASIC IDEAL VISION:The world we want to help create for tomorrow’s child

There will be no losses of life nor elimination or reduction of levels of well-being, survival, self-sufficiency, and quality of life from any source, including (but not limited to):
  • War and/or riot and/or terrorism
  • Unintended human-caused changes to the environment including permanent destruction of the environment and/or rendering it nonrenewable
  • Murder, rape, or crimes of violence, robbery, or destruction to property
  • Substance abuse
  • Disease
  • Pollution
  • Starvation and/or malnutrition
  • Destructive behavior, including child, partner, spouse, self, elder, and others
  • Discrimination based on irrelevant variable including color, race, age, creed, gender, religion, wealth, national origin, or location

Poverty will not exist, and every woman and man will earn at least as much as it costs them to live unless they are progressing toward being self-sufficient and self-reliant. No adult will be under the care, custody or control of another person, agency, or substance. All adult citizens will be self-sufficient and self-reliant as minimally indicated by their consumption being equal to or less than their production. This becomes the basis for defining a vision and mission statement that map out exactly how an organization, of any type, will add measurable value to society. Kaufman's models is argued to be the first model for business planning that makes the business case for social responsibility and that establishes a data-based construct for organizational planning and evaluation that goes beyond the walls of the organization.[11] Recent work by McKinsey & Co's Ian Davis (the Economist, 2005) aligns with this concept. The model was developed over many years, and cross multiple countries and cultures, to validate the measures. Moore conducted a factor and reliability analysis of the construct, finding that all measures loaded onto a single factor (i.e. described a single concept), r=.95 (a notably high reliability).[12] Kaufman's model has sometimes been referred to as "Kirkpatrick Plus" - an extension of Kirkpatrick's Four Levels of Evaluation[13] by adding Mega—societal value added as a fifth level. However, the debate over this is a rather long-standing one. Some practitioners in the field argue that the fifth level of evaluation is ROI, or "return on investment," evaluation.[14] (ROI is still a measure of organizational performance internally, however, and does not measure what the impact of an organization is on society).

Not all researchers agree with the idea that a systemic Ideal Vision can be engineered with such limited background knowledge. For example Boise State University Professor Don Winiecki argued that efforts at social engineering from the commonsense position proposed by Kaufman lose sight of possible side-effects and tertiary-effects from chosen means, thus of corrupting or mitigating desired ends. Winiecki asks for research that goes beyond rational laboratory experiments and ideologically informed generalizations of commonsense reasoning, in order to better understand the socio-cultural, socio-political and socio-economic systems in which social changes must be instituted.[15] As a response to this, Professor Emeritus Dale Brethower (Western Michigan University) argued to the contrary.[16] Kaufman argues that since the Ideal Vision was derived by unsystematically asking culturally and geographically diverse populations "what kind of world do you want to help create for tomorrow's child" it is relatively universal. The differences continue to be discussed.

Examples / Case Studies of Applied Mega

At the Sonora Institute of Technology (ITSON) in Sonora, Mexico, Kaufman and colleagues have worked with the President of the Institute to create a certification, Master's degree, and Ph.D. based on needs assessment and Mega planning. Students at the Ph.D. level must be working in a company or head of a company and must apply the Mega principles in a real-world project. Evidence of ITSON's results were first described by Guerra and Rodriguez.[17] ITSON also set up a Performance Improvement Institute for applied R&D where there are currently 20 organizations applying Mega thinking and planning.

Other applications include with the US Coast Guard, Concientia (Argentina), Ohio Department of Administration and the Ohio public employees union, the Australian Department of Defense, the New Zealand Army, the Republic of Pananama, Refinor de Argentina, among 100+ public and private organizations committed to adding value to all internal and external clients.

References

  1. ^ Moore, S. (2009). Interview for AECT and the University of Virginia of Roger Kaufman for the AECT “HistoryMakers” series. Part 1: http://www.youtube.com/watch?v=td5PAaJQgw0 Part 2: http://www.youtube.com/watch?v=YDoKeRAWHT4&feature=related
  2. ^ Lee, S. & Reeves, T. C. (2009; May–June). Roger Kaufman: A Significant Contributor to the Field of Educational Technology. .Educational Technology, Pp 43-45.

    Fulgham, S.M & Shaughnessy, M. (2008: Sept.-Oct.). Q & A with Ed Tech Leaders: Interview with Roger Kaufman. Educational Technology. Pp. 49-52.

  3. ^ Witkin, B. R. (1994). Needs Assessment Since 1981: The State of the Practice. Evaluation Practice, 15 (1), 17-27.
  4. ^ Kaufman, R., & English, F. W. (1979). Needs assessment: Concept and application. Englewood Cliffs, NJ: Educational Technology Publications.
  5. ^ Kaufman, R., & English, F. W. (1976). Needs assessment A guide for educational managers. Arlington, VA: American Association of School Administrators.

    Kaufman, R. A. (1972). Educational system planning. Englewood Kaufman, R. (1988). Planning educational systems: A results-based approach. Lancaster, PA: Technomic Publishers.

    Kaufman, R. (1988b). Planning for organizational success: A practical guide. (Revised) Social Impacts: Edgecliff, NSW, Australia.

    Kaufman, R. (1988c). Identifying and solving problems: A management approach. (4th ed.). Social Impacts: Edgecliff, NSW, Australia. Other editions: 3rd ed., 1982; 2nd ed., 1979; 1st ed., 1976: San Diego, CA. University Associates Publishers. Cliffs, NJ: Prentice-Hall. (Also Planificacion de systemas educativos [translation of Educational system planning]; Mexico City: Editorial Trillas, S.A., 1973.)

    Kaufman, R. (1996). Strategic Thinking: A Guide to Identifying and Solving Problems. Arlington, VA. & Washington, D.C. Jointly published by the American Society for Training & Development and the International Society for Performance Improvement

    Kaufman, R. (2000). Mega Planning: Practical Tools for Organizational Success. Thousand Oaks, CA. Sage Publications. (Also Planificación Mega: Herramientas practicas paral el exito organizacional. (2004). Traducción de Sonia Agut. Universitat Jaume I, Castelló de la Plana, Espana.)

    Kaufman, R. (2006). 30 Seconds That Can Change Your Life: A Decision-Making Guide for Those Who Refuse to be Mediocre. Amherst, MA. HRD Press Inc.

    Kaufman, R. (2006). Change, Choices, and Consequences: A Guide to Mega Thinking and Planning. Amherst, MA. HRD Press Inc. Kaufman, R. & Guerra-Lopez (2008) The Assessment Book: Applied Strategic Thinking and Performance Improvement through self-assessments, Amherst, MA. HRD Press. Kaufman, R. (2011). The Manager's Pocket Guide to Mega Thinking and Planning. Amherst, MA HRD Press. Bernardez, M., Kaufman, R., Krivatsy, A., & Arias, C. (Jan.,2012). City Doctors: A Systemic Approach to Transform Colon City, Panama. Performance Improvement Quarterly.

  6. ^ Kaufman, R. (2006). Change, Choices, and Consequences: A Guide to Mega Thinking and Planning. Amherst, MA. HRD Press Inc.
  7. ^ Kaufman, R. (2000, 2006). Mega Planning: Practical Tools for Organizational Success. Thousand Oaks, CA. Sage Publications.
  8. ^ Moore, S.L., Ellsworth, J., and Kaufman, R. (2008). Objectives: Are they useful? A Quick Assessment. Performance Improvement, 47(7), 41-47.
  9. ^ Moore, S.L. (2010). Ethics by Design: A new definition of performance standards and performance accountability. HRD Press.

    Moore, S.L., Ellsworth, J., and Kaufman, R. (2008). Objectives: Are they useful? A Quick Assessment. Performance Improvement, 47(7), 41-47.

  10. ^ Muir, M., Watkins, R. Kaufman, R., & Leigh, D. (1998: Apr.). Costs-Consequences Analysis: A Primer. Performance Improvement, 37 (4), 8-17, 48.
  11. ^ Bernardez, M. (May–June, 2009). Sailing the Winds of “Creative Destruction:” Educational Technology during economic downturns. Educational Technology.

    Bernardez, M. (2009). Minding the Business of Business: Tools and Models to Design and Measure Wealth Creation. Performance Improvement Quarterly. 22(2) Pp. 17-72.

  12. ^ Moore, S. L. (2005). The social impact of a profession: An analysis of factors influencing ethics and the teaching of social responsibility in educational technology programs. Unpublished Doctor of Philosophy dissertation, University of Northern Colorado.
  13. ^ Watkins, R., Leigh, D., Foshay, R. and Kaufman, R. (1998). Kirkpatrick Plus: Evaluation and Continuous Improvement with a Community Focus. Educational Technology Research & Development, 46(4): 90-96.
  14. ^ Phillips, J.J. (1997). Return on Investment in Training and Performance Improvement Programs. Butterworth-Heinemann.
  15. ^ Winiecki, D. J. (2004) Rejoinder to “Saving the World With HPT” A Critical, Scientific and Consultative Reflection. Performance Improvement review, ISPI. September 2004.
  16. ^ Brethower, D. M. (2005: Feb.). Yes We Can: A Rejoinder to Don Winiecki’s Rejoinder About Saving the World with HPT. Performance Improvement. Vol. 44, No. 2. Pp. 19-24.
  17. ^ Guerra, I. and Rodriguez, G. (2005). Educational Planning and Social Responsibility: Eleven Years of Mega Planning at the Sonora Institute of Technology (ITSON). Performance Improvement Quarterly, 18(3) pp. 56-64.